OPTIMIST: Opportunistic Federated Transfer Learning for Mobile Devices Using Sequential Independent Subnetwork Training

Victor II Romero, Tomokazu Matsui, Yuki Matsuda, Hirohiko Suwa, Keiichi Yasumoto: “OPTIMIST: Opportunistic Federated Transfer Learning for Mobile Devices Using Sequential Independent Subnetwork Training,” 2025 IEEE International Conference on Pervasive Computing and Communications Workshops and other Affiliated Events (PerCom '25 Workshops), pp.183-188, 2025.

Abstract

This paper introduces OPTIMIST, a federated transfer learning framework designed for opportunistic settings, where stable networks are unavailable and centralized servers are impractical. OPTIMIST leverages pre-trained backbones and enables the collaborative training of classifier heads by resource-constrained, sensor-rich edge devices. In the absence of centralized orchestration, model parameters are exchanged between mobile nodes over transient connections. To avoid catastrophic interference resulting from varying node mobility and encounter patterns, OPTIMIST adapts a conflict-free strat- egy that splits the classifier head into smaller non-overlapping subnetworks. These subnetworks are trained locally, exchanged during encounters for incremental refinement, and seamlessly reassembled into a complete classifier head. We implemented a prototype for Android devices to evaluate its practicality in cross- device scenarios. Our experiments demonstrate its effectiveness in varying degrees of data heterogeneity. Additionally, under assumptions of relatively sparse data sets on edge devices, batch training time on the order of seconds supports the feasibility of this technique in real-world environments.

Links

DOI: https://doi.org/10.1109/PerComWorkshops65533.2025.00062

PDF: https://cocolab.jp/publication/files/202503_PerComWS_Victor.pdf

BibTeX

code:references.bib

@inproceedings{bib:victor_optimist_percom2025,

author={Romero, Victor II and Matsui, Tomokazu and Matsuda, Yuki and Suwa, Hirohiko and Yasumoto, Keiichi},

title={OPTIMIST: Opportunistic Federated Transfer Learning for Mobile Devices Using Sequential Independent Subnetwork Training},

booktitle={2025 IEEE International Conference on Pervasive Computing and Communications Workshops and other Affiliated Events (PerCom '25 Workshops)},

pages={183--188},

year={2025},

doi={10.1109/PerComWorkshops65533.2025.00062},

url={https://doi.org/10.1109/PerComWorkshops65533.2025.00062}

}

https://scrapbox.io/files/68cb58a6ef4980fb43c6934f.png